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Abstract 

The goal of this paper is to unify two lines in a particular area of graph 
limits. First, we generalize and provide unified treatment of various graph 
limit concepts by means of a combination of model theory and analysis. 
Then, as an example, we generalize limits of bounded degree graphs from 
subgraph testing to finite model testing. 

1 Introduction 

Recently, graph sequences and graph limits are intensively studied, from diverse 
point of views: probability theory and statistics, property testing in computer 
science, flag algebras, logic, graphs homomorphisms, etc. Four standard notions 
of graph limits have inspired this work: 

• the notion of dense graph limit [H I15j ; 

• the notion of bounded degree graph limit [31 [2] ; 

• the notion of elementary limit e.g. |12[ 113] 

• the notion of left limit developed by the authors [2Ql [21] . 

Let us briefly introduce these notions. Our combinatorial terminology is 
standard and we refer to the standard books (such as [12l H3 [2TJ [23] ) or original 
papers for more information. 
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is supported by grant ERCCZ LL-1201 of the Czech Ministry of Education and CE-ITI of 
GACR 



The first approach consists in randomly picking a mapping from a test graph 
and to check whether this is a homomorphism. A sequence (G n ) of graphs will 
be said to be L-convergent if 

hom(F,G n ) 



t(F, G r , 



\G n \W 



converges for every fixed (connected) graph F. 

The second one is used to define the convergence of a sequence of graphs 
with bounded degrees. A sequence (G n ) of graphs with bounded maximum 
degrees will be said to be BS- convergent if, for every integer r, the probability 
that the ball of radius r centered at a random vertex of G n is isomorphic to a 
fixed rooted graph F converges for every F. 

The third one is a general notion of convergence based on the first-order 
properties satisfied by the elements of the sequence. A sequence (Gj)igN is 
elementarily convergent if, for every sentence <fi there exists an integer such 
that either all the Gi with i > satisfy (f> or none of them do. 

The fourth notion of convergence is based in testing existence of homomor- 
phisms from fixed graphs: a sequence (G n ) is said to be left- convergent if, for 
every graph F, either all but a finite number of the graphs G n contain a ho- 
momorphic image of F or only a finite number of G n does. In other words, 
left-convergence is a weak notion of elementary convergence where we consider 
primitive positive sentences only. 

These four notions proceed in different directions and, particularly, relate to 
either dense or sparse graphs. The sparse-dense dichotomy seems to be a key 
question in the area. 

In this paper we provide a unifying approach to these limits. Our approach 
is a combination of a functional analytic and model theoretic approach and thus 
applies to applies to more general structures (rather than graphs) . Thus we use 
term structural limits. 

The paper is organized as follows: In Section[2]we briefly introduce a general 
machinery based on the Boolean algebras and dualities, see [TO] for standard 
background material. In section [3] we apply this to Lindenbaum-Tarski algebras 
to get a representation of limits as measures (Theorem [T]) . In section [4] we 
mention an alternative approach by means of ultraproducts (i.e. a non-standard 
approach) which yields another representation (of course ineffective) of limits 
(Proposition [4]). In section [5] we relate this to examples given in this section and 
particularly state results for bounded degree graphs, thus extending Benjamini- 
Schramm convergence [3] to the general setting of FO-convergence (Theorem^. 
In the last section, we discuss the type of limit objects we would like to construct, 
and introduce some applications to the study of particular cases of first-order 
convergence which are going to appear elsewhere. 



2 Boolean Algebras, Stone Representation, and 
Measures 

Recall that a Boolean algebra B is an algebra with two binary operations V 
and A, a unary operation -i and two elements and 1, such that (B, V,A) is 
a distributive lattice with minimum and maximum 1 which is complemented 
(in the sense that the complementation -i satisfies a V ~^a — 1 and a A = 0). 
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The smallest Boolean algebra, denoted 2, has elements and 1. In this 
Boolean algebra it holds OAa = 0,lAa = a,OVa = a,lVa=l,-iO = l, and 
-■1 = 0. Another example is the powerset 2 X of a set X has a natural structure 
of Boolean algebra, with = 0, 1 = X, A\J B = A\J B, A A B = An B and 
-nA = X \ A. 

Key examples for us are the following: 

Logical Example 1. The class of all first-order formulas on a language £, 
considered up to logical equivalence, form a Boolean algebra with conjunction 
V, disjunction A and negation -i and constants "false" (0) and "true" (1). This 
Boolean algebra will be denoted FO(£). 

Also, we denote by FOq(£) the Boolean algebra of all first-order sentences 
(i.e. formulas without free variables) on a language C, considered up to logical 
equivalence. Note FOo(£) is a Boolean sub-algebra of FO(£). 

Logical Example 2. Consider a logical theory T (with negation). The Lindenbaum- 
Tarski algebra Lt of T consists of the equivalence classes of sentences of T (here 
two sentences <f> and ip are equivalent if they are provably equivalent in T) . The 
set of all the first-order formulas that are provably false from T forms an ideal 
It of the Boolean algebra FOq(jC) and Lt is nothing but the quotient algebra 
FO (£)At. 

With respect to a fixed Boolean algebra B, a Boolean function is a function 
obtained by a finite combination of the operations V, A, and -i. 

Recall that a function / : B — > B' is a homomorphism of Boolean algebras 
if f(a V b) = f(a) V /(&), f(a A b) = /(a) A /(&), /(0) = and /(l) = 1. A 
filter of a Boolean algebra B is an upper set X (meaning that x € X and y > x 
imply y G X) that is a proper subset of B and that is closed under A operation 
(Vx, y G X it holds lAyel). It is characteristic for Boolean algebras that 
the maximal filters coincide with the prime filters, that is, the (proper) filters 
X such that a V b G X implies that either a G X or b G X. One speaks of 
the maximal (i.e. prime filters) as of ultrafilters (they are also characterized by 
the fact that for each a either a £ X or -^a G X). It is easily checked that the 
mapping / > is a bijection between the homomorphisms B — > 2 and 

the ultrafilters on B. 

A Stone space is a compact Hausdorff with a basis of clopen subsets. With 
a Boolean algebra B associate a topological space 

S(B) = ({x, x is a ultrafilter in B},t), 

where r is the topology generated by all the K B {b) — {x, b G x} (the subscript 
B will be omitted if obvious). Then S(B) is a Stone space. By the well-known 
Stone Duality Theorem [21], the mappings B i-> S(B) and X i-> fi(X), where 
Q,(X) is the Boolean algebra of all clopen subsets of a Stone space X, constitute 
a one-one correspondence between the classes of all Boolean algebras and all 
Stone spaces. 

In the language of category theory, Stone's representation theorem means 
that there is a duality between the category of Boolean algebras (with homo- 
morphisms) and the category of Stone spaces (with continuous functions). The 
two contravariant functors defining this duality are denoted by S and Q and 
defined as follows: 
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For every homomorphism h : A — > B between two Boolean algebra, we define 
the map S(h) : S(B) -> S(A) by S(h)(g) = g o h (where points of S(B) are 
identified with homomorphisms g : B — > 2). Then for every homomorphism 
/i : A — > _B, the map : <S I (B) — > 5(A) is a continuous function. Conversely, 
for every continuous function / : X — > F between two Stone spaces, define the 
map n(/) : 0(F) -> Q(X) by 0(/)(J7) = /^(C/) (where elements of Q(X) are 
identified with clopen sets of X). Then for every continuous function / : X — > F, 
the map 0(/) : 0(F) — > Q(X) is a homomorphism of Boolean algebras. 

We denote by K = ft o S one of the two natural isomorphisms defined by 
the duality. Hence, for a Boolean algebra B, K(B) is the set algebra {Kb(o) ■ 
b e £>}, and this algebra is isomorphic to B. 

Thus we have a natural notion for convergent sequence of elements of S(B) 
(from Stone representation follows that this may be seen as the pointwise con- 
veregence) . 

Logical Example 3. Let B — F0o(£) denote the Boolean Lindenbaum-Tarski 
algebra of all first-order sentences on a language C up to logical equivalence. 
Then the filters of B are the consistent theories of FOq(C) and the ultrafilters 
of B are the complete theories of FOq(C) (that is maximal consistent sets of 
sentences). It follows that the closed sets of S(B) correspond to finite sets of 
consistent theories. According to Godel's completeness theorem, every consis- 
tent theory has a model. It follows that the completeness theorem for first-order 
logic — which states that that a set of first-order sentences has a model if and 
only if every finite subset of it has a model — amounts to say that S(B) is 
compact. The points of S(B) can also be identified with elementary equivalence 
classes of models. The notion of convergence of models induced by the topology 
of S(B), called elementary convergence, has been extensively studied. 

An ultrafilter on a Boolean algebra B can be considered as a finitely additive 
measure, for which every subset has either measure or 1. Because of the 
equivalence of the notions of Boolean algebra and of set algebra, we define the 
ba space b&(B) of B has the space of all bounded additive functions / : B — >• M. 
Recall that a function / : B — > K is additive if for all x, y £ B it holds 

xAy^O => f(xVy) = f(x) + f(y). 

The space b&(B) is a Banach space for the norm 

||/|| = sup /(*)- mi U{x). 
xeB zee 

(Recall that the ba space of an algebra of sets S is the Banach space consisting of 
all bounded and finitely additive measures on £ with the total variation norm.) 

Let h be a homomorphism B — > 2 and let l : 2 — > R be defined by t(0) = 
and i(l) = 1. Then i o h € ba(£>). Conversely, if / € ba(_B) is such that 
f(B) = {0, 1} then o / is a homomorphism B — > 2. This shows that S(B) 
can be identified with a subset of b&(B). 

One can also identify ba,(B) with the space ba.(K(B)) of finitely additive 
measure defined on the set algebra K(B). As vector spaces ba(i3) is isomor- 
phic to b&(K(B)) and thus ba(£>) is then clearly the (algebraic) dual of the 
normed vector space V(B) (of so-called simple functions) generated by the in- 
dicator functions of the clopen sets (equipped with supremum norm) . Indicator 
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functions of clopen sets are denoted by !«-(&) (f° r some b e B) and denned by 



l Kb (x) = I 1 ifxe ^W 
K ^ 1 otherwise. 

The pairing of a function / e ba(S) and a vector X = E"=i a i^-K(bi) is 
defined by 

n 

[/,*] = 5>/(6i). 

i=l 

That [/, X] does not depend on a particular choice of a decomposition of A 
follows from the additivity of /. We include a short proof for completeness: 
Assume Ei"* 1 *:^) = EiA 1 ^*)- As for ever y b,b' e B it holds /(&) = 
/(& A b') + f(b A -if/) and 1k(6) = lir(&A6') + 1k(6a-.6') we can express the two 
sums as ^ otjl K (b'.) = Ej P'j^-K{b'.) (where b\ A b' 3 • = for every i 7^ j), with 
E, = Ej and £. ft/(6i) = E; Pjfty). As A b) = for every 

i ^ j, for x € K(b'j) it holds a'j = X(x) = /3j. Hence a'j — f3j for every j. Thus 

Ei«i/(M = EiA/(6i)- 

Note that A i->- [/, A] is indeed continuous. Thus ba(_B) can also be identified 
with the continuous dual of V(B). We now show that the vector space V(B) 
is dense in the space C(S(B)) of continuous functions from S(B) to R, hence 
that ba(£?) can also be identified with the continuous dual of C(S(B)): 

Lemma 1. The vector space V(B) is dense in C(S(B)) (with the uniform 
norm). 

Proof. Let / e C(S(B)) and let e > 0. For z e f(S(B)) let U z be the prcimage 
by / of the open ball B e / 2 (z) of K centered in z. As / is continuous, U z is a open 
set of S{B). As {K{b) : b e £?} is a basis of the topology of S'(-B), 14 can be 
expressed as a union [j be ^ Uz) K(b). It follows that LU/(s(b)) U 6e ^(^) 
is a covering of S(B) by open sets. As S(B) is compact, there exists a finite 
subset T of Uze/(s(B)) F{U Z ) that covers 5(B). Moreover, as for every b,b' e £> 
it holds A(fe) n A(fe') = K(b A 6') and A(6) \ K{b') = K(b A -.{/) it follows that 
we can assume that there exists a finite family J 7 ' such that S(B) is covered by 
open sets K{b) (for 6 e J 7 ') and such that for every b € F' there exists b' E J 7 
such that A(6) C K(b'). In particular, it follows that for every 6 e J 7 ', f(K(b)) 
is included in an open ball of radius e/2 of K. For each b £ J 7 ' choose a point 
e S'(-B) such that b <E x b . Now define 

be J 7 ' 

Let a; e 5(5). Then there exists b e T' such that x e K(b). Thus 
\f(x)-f(x)\ = \f(x)-f(x b )\<e. 

Hence ||/ - /IU < e. □ □ 

It is difficult to exhibit a basis of C(S(B)) or V(B). However, every meet 
sub-semilattice of a Boolean algebra B generating B contains (via indicator 
functions) a basis of V(B): 
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Lemma 2. Let X C B be closed by A and such that X generates B (meaning 
that every element of B can be obtained as a Boolean junction of finitely many 
elements from X ). 

Then {If, : b G X} U {1} (where 1 is the constant function with value 1) 
includes a basis of the vector space V(B). 

Proof. Let b E B. As X generates B there exist b\, . . . , S X and a Boolean 
function F such that b — F(bi, . . . , 6ft). As l xAy = l x l y and l^ x = 1 — l x 
there exists a polynomial Pp such that 1& = Pp(lf )1 , . . . , lb k )- For / C [k], the 
monomial Yiiei ^-h rewrites as 1^ where 6/ = f\ ieI bi. It follows that 1;, is a 
linear combination of the functions lf, 7 (J C [fc]) which belong to X if I ^ (as 
A is closed under A operation) and equal 1, otherwise. □ □ 

We are coming to the final transformation of our route: One can see that 
bounded additive real- value functions on a Boolean algebra B naturally define 
continuous linear forms on the vector space V(B) hence, by density, on the 
Banach space C(S(B)) (of all continunous functions on S(B) equipped with 
supremum norm). It follows (see e.g. |23p from Riesz representation theorem 
that the topological dual of C(S(B)) is the space ic&(S(B)) of all regular count- 
ably additive measures on S(B) . Thus the equivalence of ba(J3) and rca(S'(i?)) 
follows. We summarize all of this as the following: 

Proposition 1. Let B be a Boolean algebra, let ba(_B) be the Banach space of 
bounded additive real-valued functions equipped with the norm \\f\\ = sup bgB f(b) — 
infbgs f(b), let S(B) be the Stone space associated to B by Stone representation 
theorem, and let rca(S*(i?)) be the Banach space of the regular countably additive 
measure on S(B) equipped with the total variation norm. 

Then the mapping Ck ■ rca(5(B)) — > b&(B) defined by Ck (m) = H°K is an 
isometric isomorphism. In other words, Ck is defined by 

C K (n)(b) = n({x e S(B) ; bex}) 

(considering that the points of S(B) are the ultrafilters on B). 

Note also that, similarly, the restriction of Ck to the space Pr(S(B)) of all 
(regular) probability measures on S(B) is an isometric isomorphism of Pr(S'(i?)) 
and the subset bai(B) of ba(-B) of all positive additive functions / on B such 
that /(l) = 1. 

A standard notion of convergence in rca(5(B)) (as the continuous dual of 
C(S(B))) is the weak *-convergence: a sequence (^ n )neN of measures is conver- 
gent if, for every / £ C(S(B)) the sequence / f(x) dfj, n (x) is convergent. Thanks 
to the density of V(B) this convergence translates as pointwise convergence in 
ba(_B) as follows: a sequence ((7 n )„gN of functions in ba(_B) is convergent if, for 
every b € B the sequence (g n (b)) n eN is convergent. As rca(5(B)) is complete, 
so is rca(i?). Moreover, it is easily checked that bai(£?) is closed in ba(£>). 

In a more concise way, we can write, for a sequence (/ n )neN of functions 
in ba(-B) and for the corresponding sequence (fif ) n eN of regular measures on 
S(B): 

lim f n pointwise <S=J> \it => fit. 
n— >oo 71 

The whole situation is summarized on Fig. [T] 
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Stone duality 



D ~ K(B) 



S(B) 



(injection) 




C(S(B)) 



dense 
subspace 



V(B) 



Figure 1: Several spaces denned from a Boolean algebra, and their inter- 
relations. 



The above theory was not developed for its own sake but in order to demon- 
strate a natural approach to structural limits. The next example is a continua- 
tion of our main interpretation, which we started in Logical examples [2] and [3j 

Logical Example 4. Let B — FOo(£) denote the Boolean algebra of all first- 
order sentences on a language C up to logical equivalence. We already noted 
that the points of S(B) are complete theories of FOo(£), and that each complete 
theory has at least one model. Assume £ is a finite language. Then for every 
n £ N there exists a sentence (j> n such that for every complete theory T £ FOq(C) 
it holds <j) n G T if and only if T has a unique model and this model has at most n 
elements. Let U — Un>i -^"(^n)- Then U is open but not closed. The indicator 
function \jj is thus measurable but not continuous. This function has the nice 
property that for every complete theory T 6 S(B) it holds 

I 1, if T has a finite model; 
lu(T) = < ' 

I 0, otherwise. 



3 Limits via Fragments and Measures 

We provide a unifying approach based on the previous section. We consider 
the special case of Boolean algebras induced by a fragment of the class FO(£) 
of the first-order formulas over a finite relational language C. In this context, 
the language C will be described by its signature, that is the set of non-logical 
symbols (constant symbols, and relation symbols, along with the arities of the 
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relation symbols). An FO(£)- structure is then a set together with an interpre- 
tation of all relational and function symbols. Thus for example the signature of 
the language CP of graphs is the symbol <~ interpreted as the adjacency relation: 
x ~ y if {x, y} is an edge of the graph. 

We now introduce our notion of convergence. Our approach is a combination 
of model theoretic and analytic approach. 

Recall that a formula is obtained from atomic formulas by the use of the 
negation (-1), logical connectives (V and A), and quantification (3 and V). A 
sentence (or closed formula) is a formula without free variables. 

The quantifier rank qrank(0) of a formula is the maximum depth of a 
quantifier in 0. For instance, the quantifier rank of the formula 

3a; ((By (x ~ y)) V (Vy Vz -.(a; ~ y) A -.(j, ~ z))) 

has quantifier rank 3. 

The key to our approach is the following definition. 

Definition 1. Let <f>(x\, . . . ,x p ) be a first-order formula with p free variables 
(in the language C) and let G be an /^-structure. We denote 

(0, Cr) ' ^ • (1) 

In other words, (0, G) is the probability that is satisfied in G when the p 
free variables correspond to a random p-tuple of vertices of G. The value {(/>, G) 
is called the density of 4> m G. Note that this definition is consistent in the 
sense that although any formula (f> with p free variables can be considered as a 
formula with q > p free variables with q — p unused variables, we have 



\{{v!, . . . ,Vg) : G |= ■ ■ .,v P )}\ = \{(vi, ...,v P ): G h H v u ■ ■ -,Vp)}\ 
|G|« \G\p 

It is immediate that for every formula <f) it holds (-xf>, G) = 1 — (<p, G). 
Moreover, if <f>i, . . . , <fi n are formulas, then by de Moivre's formula, it holds 

(\/^,G> = x:(-i) fe+1 ( E <A^< G >)- 

i=l k=l ^l<i l <---<i k <n j=l ' 

In particular, if <f>i, . . . , <f>k are mutually exclusive (meaning that </>, and 4>j 
cannot hold simultaneously for i ^ j) then it holds 



(V<Ai,G> = X>- G >- 



i=i i=i 

In particular, for every fixed graph G, the mapping <j> h- !► (cf>, G) is additive 
(i.e. (-,G) e ba(FO(£))): 

0i A 02 = => (0iV0 2 ,G) = (0i,G) + (0 2 ,G). 

Thus we may apply the above theory to additive functions ( • , G) and to 
structural limits we shall define now. 
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Advancing this note that in the case of a sentence <f> (that is a formula with 
no free variables, i.e. p = 0), the definition reduces to 



Thus the definition of (4>, G) will suit to the elementary convergence. Ele- 
mentary convergence and all above graph limits are captured by the following 
definition: 

Definition 2. Let A be a fragment of FO(£). 

A sequence (G n ) n eN of /^-structures is X-convergent if for every (f> £ X, the 
sequence ((0, G„))„ s n converges. 

For a Boolean sub- algebra X of FO(£), we define T(A) has the space of 
all ultrafiltcrs on A, which we call complete X-theories. The space 1(A) is 
endowed with the topology defined from its clopen sets, which are defined as 
the sets K(<p) = {T e T(A) : T 3 <fi} for some <j> € A. In the sake for simplicity, 
we denote by 1^ (for <j> e A) the indicator function of the clopen set K{<j>) 
defined by <j>. Hence, 1 (T) = 1 if <j> e T, and 1 (T) = otherwise. 

It should be now clear that the above general approach yields the following: 

Theorem 1. Let X be a Boolean sub-algebra o/FO(£) and let Q be the class 
of all finite C-structures. 

There exists an injective mapping G i— > \iq from Q to the space of probability 
measures on 1(A) such that for every <f> £ X it holds 



A sequence (G„)„ e N of finite C-structures is X-convergent if and only if the 
sequence (^G„)neN is weakly convergent. Moreover, if /xg„ ==> M then for every 
<p £ X it holds 



In this paper, we shall be interested in specific fragments of FO(£): 

• FO(£) itself; 

• FO p (£) (where p g N), which is the fragment consisting of all formulas 
with at most p free variables (in particular, FOo(£) is the fragment of all 
first-order sentences); 

• QF(£), which is the fragment of quantifier-free formulas (that is: prepo- 
sitional logic); 

• F0 local (£), which is the fragment of local formulas, defined as follows. 

Let r G N. A formula <j>(xi, . . . ,x p ) is r -local if, for every £-structure G and 
every v\ , . . . , v p € G p it holds 





71- 




G \= 4>{vi,. ■ ■ ,v p ) ^=> G[N r (vi, . . . , v p )] \— <f)(vi, . . . , v p ), 
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where N r (vi, . . . , v p ) is the closed r- neighborhood of the ^-structure 

G (that is the set of elements at distance at most r from at least one of x\, . . . , x p 
in the Gaifman graph of G), and where G[A] denotes the sub-£-structure of G 
induced by A. A formula cf> is local if it is r-local for some r £ N; the fragment 
F0 local (£) is the set of all local formulas (over the language £). This fragment 
form an important fragment, particularly because of the following structure 
theorem. 

Theorem 2 (Gaifman locality theorem [9]). For every first- order formula 4>(x\, . . . 
there exist integers t and r such that </> is equivalent to a Boolean combination 
of t-local formulas £j (x^ , . . . , Xi s ) and sentences of the form 

B yi ...3y m ( f\ dist(^, % ) > 2rA f\ V(^)J (2) 

l<2<_7<m l<i<m 

where tp is r-local. Furthermore, if <\> is a sentence, only sentences ^ occur 
in the Boolean combination. 

From this theorem follows a general statement: 

Proposition 2. Let (G n ) be a sequence of graphs. Then (G„) is FO-convergent 
if and only if it is both F0 local -convergent and elementarily-convergent. 

Proof. Assume (G n ) n gN is both F0 local -convergent and elementarily-convergent 
and let <f> £ FO be a first order formula with n free variables. According to 
Theorem [2j there exist integers t and r such that <fi is equivalent to a Boolean 
combination of Hocal formula £ (x il , . . . , Xi s ) and of sentences. It follows that 
(<j>, G) can be expressed as a function of values of the form (£, G) where £ is 
either a local formula or a sentence. Thus {G n )nen is FO-convergent. □ □ 

Notice that if <f>\ and <p2 are local formulas, so are <f>\ A <f>2, 4>i V 02 and 
— i0i . It follows that F0 local is a Boolean sub-algebra of FO. It is also clear 
that all the other fragments described above correspond to sub-algebras of FO. 
This means that there exist canonical injective Boolean-algebra homomorphisms 
from these fragments X to FO, that will correspond to surjective continuous 
functions (projections) from 5*(FO) to S(X) and it is not hard to see that they 
also correspond to surjective maps from ba(FO) to ba(X) and to surjective 
pushforwards from rca(S'(FO) to rca(S(Jf)). 

Recall that a theory T is a set of sentences. (Here we shall only consider 
first-order theories, so a theory is a set of first-order sentences.) The theory T is 
consistent if one cannot deduce from T both a sentence <j> and its negation. The 
theory T is satisfiable if it has a model. It follows from Godel's completeness 
theorem that, in the context of first-order logic, a theory is consistent if and only 
if it is satisfiable. Also, according to the compactness theorem, a theory has a 
model if and only if every finite subset of it has a model. Moreover, according 
to the downward Lowenhcim-Skolem theorem, there exists a countable model. 
A theory T is a complete theory if it is consistent and if, for every sentence 
4> £ FOo(£), either <fi or ^<f> belongs to T. Hence every complete theory has a 
countable model. However, a complete theory which has an infinite model has 
infinitely many non-isomorphic models. 

It is natural to ask whether one can consider fragments that are not Boolean 
sub-algebras of FO(£) and still have a description of the limit of a converging 
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sequence as a probability measure on a nice measurable space. There is obvi- 
ously a case where this is possible: when the convergence of (<fi, G„) for every <f> 
in a fragment X implies the convergence of (ip, G n ) for every tj) in the minimum 
Boolean algebra containing X. We prove now that this is an instance of a more 
general phaenomenon: 

Proposition 3. Let X be a fragment ofFO(C) closed under (finite) conjunction 
— that is: a meet semilattice o/FO(£) — and let BA(X) be the Boolean algebra 
generated by X (that is the closure of X by V,A and -i). Then X -convergence 
is equivalent to BA(JT) -convergence. 

Proof. Let ^ € BA(X). According to Lemma[2j there exist </>i, . . . , 4>k & X and 
ao, oil, ■ ■ ■ , a k G K such that 

k 

1* = aol + ^ otil^,. 
»=1 

Let G be a graph, let f2 = 5(BA(X)) and let [Iq e rca(ft) be the associated 
measure. Then 

(*,G} = / l*d// G = / (a l + V"a i l^,.)d/x G = o:o + V"ai^i,G). 

Thus if (G n )„ G N is an X-convergent sequence, the sequence ((ip,G n )) n€ m 
converges for every ip € BA(X), that is (G„)„ s n is BA(X)-convergent. □ □ 

Continuing to develop the general mechanism for the structural limits we 
consider fragments of FO quantified by the number of free variables. 

We shall allow formulas with p free variables to be considered as a formula 
with q > p variables, q — p variables being unused. As the order of the free 
variables in the definition of the formula is primordial, it will be easier for us 
to consider sentences with p constants instead of formulas with p free variables. 
Formally, denote by C p the language obtained from C by adding p (ordered) 
symbols of constants ci,...,c p . There is a natural isomorphism of Boolean 
algebras v v : FO p (£) — > FO (C p ), which replaces the occurrences of the p free 
variables Xi,...,x p in a formula <p € FO p by the corresponding symbols of 
constants Ci, . . . , c p , so that it holds, for every graph G, for every (f> € FO p and 
every vi, . . . , v p G G: 

G\= (fi(vi,...,Vp) {G,Vi,...,v v )\=v v (4>). 

The Stone space associated to the Boolean algebra FOo(£ p ) is the space 
T(£ p ) of all complete theories in the language C p . Also, we denote by 
the Stone space representing the Boolean algebra T(FOo(£ w )) ~ FO. One of 
the specific properties of the spaces T(£ p ) is that they are endowed with an 
ultrametric derived from the quantifier-rank: 

H-tfT 7M = J° if T X =T 2 

1 11 2 > y 2 - min ^ nk ^- OZTAT*} otherwise. 

This ultrametric defines the same topology as the Stone representation theorem. 
As a compact metric space, %(C P ) is (with the Borel sets defined by the metric 
topology) a standard Borel space. 



11 



For each p > 0, there is a natural projection ir p : T p +i — > T p , which maps 
a complete theory T S T P +i to the subset of T containing the sentences where 
only the p first constant symbols c\, . . . , c p are used. Of course we have to check 
that 7T P (T) is a complete theory in the language C p but this is indeed so. 

According to the ultrametrics defined above, the projections ir p are con- 
tractions (hence are continuous). Also, there is a natural isometric embedding 
rj p : 1 P — > 1p+i defined as follows: for T e T p , the theory %(T) is the deductive 
closure of T U {c p — c p+ {\. Notice that r] p (T) is indeed complete: for every 
sentence € FO(£ p +i), let be the sentence obtained from by replacing 
each symbol c p +i by c p . It is clear that c p = c p +i h ■<-> 0. As either or 
^0 belongs to T, either or ^0 belongs to r] p (T). Moreover, we deduce easily 
from the fact that and have the same quantifier rank that rj p is an isometry. 
Finally, let us note that ix p o r\ p is the identity of % p . 

For these fragments we shall show a particular nice construction, well non- 
standard construction, of limiting measure. 

4 A Non-standard Approach 

The natural question that arises from the result of the previous section is 
whether one can always find a representation of the FO-limit of an FO-converging 
sequence by a "nice" measurable /^-structure. 

It appears that a general notion of limit object for FO-convergence can 
be obtained by a non-standard approach. In this we follow closely Elek and 
Szegedy [7]. 

We first recall the ultraproduct construction. Let (G n ) n &! be a finite se- 
quence of finite /^-structures and let U be a non-principal ultrafilter. Let 
G = IlieN and let ~ be the equivalence relation on V defined by (x n ) ~ (y n ) 
if {n : x n — y n } € U. Then the ultraproduct of the /^-structures G n is the 
quotient of G by ~, and it is denoted ric/^- For each relational symbol R 
with arity p, the interpretation R of R in the ultraproduct is defined by 

([v 1 ],...,[v p })€R d {n:(vl... :V P)eR G -}eU. 

The fundamental theorem of ultraproducts proved by Los makes ultraprod- 
ucts particularly useful in model theory. We express it now in the particular 
case of £-structures indexed by N but its general statement concerns structures 
indexed by a set / and the ultraproduct constructed by considering an ultrafilter 
U over /. 

Theorem 3 ([14 ). For each formula (fi(x\, . . . , x p ) and each v , . . . , v p G Yii Gi 

we have 

J] Gi H ^[v 1 ], . . . , [«"]) iff {i : Gi h <t>{vh ■ • • , <)} G U. 
u 

Note that if (Gi) is elementary-convergent, then Yiu Gi is an elementary 
limit of the sequence: for every sentence 0, according to Theorem |3j we have 

|=0 ^ {i : Gi |=0} Gt/. 

u 
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A measure v extending the normalised counting measures Vi of Gi is then 
obtained via the Loeb measure construction. We denote by V(Gi) the Boolean 
algebra of the subsets of vertices of Gi , with the normalized measure Vi (A) = 
XJr. We define V — f\ i 1 > where / is the ideal of the elements 

such that {i : A. L = 0} G U. We have 

[x] £ [A] iff {» : Xi G At} G U. 

These sets form a Boolean algebra over Ilc/Ci- Recall that the ultralimit 
limjj a n defined for every (a n ) ne m £ £°°(N) is such that for every e > we 
have 



{i : a,i G [lim a n — e ; Una a n + e]} G {/. 

Define 

= lim^(A 4 ). 

Then v : V —> K is a finitely additive measure. Remark that, according 
to Hahn-Kolmogorov theorem, proving that v extends to a countably additive 
measure amounts to prove that for every sequence ([j4™]) of disjoint elements of 
V such that \] n \A n \ G V it holds v([) n [A n ]) = £ n K[^ n ])- 

A subset A C LJ^ Gi is a nullset if for every e > there exists L4 e ] G V 
such that A C [A € ] and ^([A c ]) < e. The set of nullsets is denoted by Af. A set 
B C Ylu Gi is measurable if there exists B £ V such that BAB G A/". 

The following theorem is proved in [7]: 

Theorem 4. TTie measurable sets form a a-algebra Bjj and v(B) = v(B) de- 
fines a probability measure on Bjj . 

Notice that this construction extends to the case where to each Gi is as- 
sociated a probability measure Vi. Then the limit measure v is non-atomic if 
and only if the following technical condition holds: for every e > and for 
every (A n ) G ^ f° r U- almost all n it holds v n (A n ) > e then there ex- 

ists 8 > and (B n ) £ Yi G n such that for [/-almost all n it holds B n C A n 
and min(i/„(i? n ), v n (A n \ B n )) > 5. This obviously holds if v n is a normalized 
counting measure and limy \G n \ = oo. 

Let fi : Gi —} [—d; d] be real functions, where d > 0. One can define 

/(M) = hm/i^). 

We say that / is the ultralimit of the functions {/i}igN and that / is an ultralimit 
function. 

Let <p(x) be a first order formula with a single free variable, and let ff : 
d -> {0, 1} be defined by 




otherwise. 



and let : lie/ ~~ * {^j 1} be defined similarly on the £-structure_T[ ;7 Gi. 
Then is the ultralimit of the functions {ff } according to Theorem u3l 
The following lemma is proved in [7]. 
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Lemma 3. The ultralimit functions are measurable on Y[jj Gi and 

/di/ = hm — . 

In particular, for every formula 4>(x) with a single free variable, we have: 

u ({l x ] : Yl Gi h0(N)}) =hm(^,G,). 
u 

Let tf)(x, y) be a formula with two free variables. Define /j : Gi — > [0; 1] by 

= ^ ■ 

and let 

f([x])= f i({[y]:Y[G l ^^([ X ],[y]}). 

u 

Let us check that /([x]) is indeed the ultralimit of /j(xj). Fix [x]. Let gi : Gi —, i 
{0, 1} be defined by 

1 if |= ip(xi,y) 
otherwise. 



ffi(2/) 

and let g : Ylu Gi — > {0, 1} be defined similarly by 

g([y}) 



1 if UuGi \=fl>([x],\y]) 
otherwise. 



According to Theorem [3] we have 

It follows that (7 is the ultralimit of the functions {<7i}igN- Thus, according to 
Lemma [3] we have 

that is: 

/([x])=lim/ i (x i ). 

Hence / is the ultralimit of the functions and, according to Lemma |3j 

we have 

' r M[x\M) <MM) <MM) = itai^,G < ). 

This property extends to any number of free variables. We formulate this as 
a summary of the results of this section. 
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Proposition 4. Let (G„)„gN be a sequence of finite C-structures and let U be a 
non-principal ultrafilter on N. Then there exists a measure v on the ultraproduct 
G = Y[jj G„ such that for every first-order formula <f> with p free variables it 
holds: 

■ J l<f,([xi], . . . , [x p ]) dv([xi]) ... dv([xp\) = lim(ip,Gi). 

Gp 

Moreover, the above integral is invariant by any permutation on the order of the 
integrations: for every permutation a of [p] it holds 



lim(V>, Gi) = ■ ■ ItfQzi], • • • , [xp]) du([x aW }) . . . dv([x a(p) }). 



Gp 



However, the above constructed measure algebra is non-separable (see [5] 
for discussion). 



5 A Particular Case 

Instead of restricting convergence to a fragment of FO(£), it is also interesting 
to consider restricted classes of structures. For instance, the class of graphs 
with maximum degree at most D (for some integer D) received much attention. 
Specifically, the notion of local weak convergence of bounded degree graphs was 
introduced in [3]: 

A rooted graph is a pair (G, o), where o G V(G). An isomorphism of rooted 
graph 4> : (G, o) — > (G',o') is an isomorphism of the underlying graphs which 
satisfies <j>{6) = o'. Let D € N. Let Gd denote the collection of all isomor- 
phism classes of connected rooted graphs with maximal degree at most D. For 
simplicity's sake, we denote elements of Gd simply as graphs. For (G, o) € Gd 
and r > let Bg(o, r) denote the subgraph of G spanned by the vertices at 
distance at most r from o. If (G, o), (G',o') € Gd and r is the largest integer 
such that (BG(o,r),o) is rooted-graph isomorphic to (Bg> (o', r), o'), then set 
p((G,o), (G',o')) = 1/r, say. Also take p((G,o), (G,o)) = 0. Then p is metric 
on Gd- Let DJId denote the space of all probability measures on Gd that are 
measurable with respect to the Borel cr-field of p. Then DJId is endowed with 
the topology of weak convergence, and is compact in this topology. 

A sequence (G„) n gN of finite connected graphs with maximum degree at 
most D is BS-convergent if, for every integer r and every rooted connected 
graph [F, o) with maximum degree at most D the following limit exists: 

Um \{v:B Gn (v,r)^(F,o)}\ ^ 
n-yao \G n \ 

This notion of limits leads to the definition of a limit object as a probability 
measure ouQd [3]- 

However, as we shall see below, a nice representation of the limit structure 
can be given. To relate BS-convergence to X-convergence, we shall consider the 
fragment FO 1 ] 003,1 of those formulas with at most 1 free variable that are local. 
Formally, let FOi° cal = F0 local n FOi. 



15 



Proposition 5. Let (G n ) be a sequence of finite graphs with maximum degree 
d, with lim„_ ) . 00 \G n \ = oo. 

Then the following properties are equivalent: 

1. the sequence (G„) n£ N is BS-convergent; 

2. the sequence (G„)neN is FO]° ca -convergent; 

3. the sequence (G n ) n ^jq is F0 local -convergent. 

Proof. If (G„) neN is F0 local -convergent, it is FO^-convergent; 

If (G„)„ g n is FO'^'-convcrgent then it is BS-convergent as for any finite 
rooted graph (F, o), testing whether the the ball of radius r centered at a vertex 
x is isomorphic to (F, o) can be formulated by a local first order formula. 

Assume (G n ) n eN is BS-convergent. As we consider graphs with maximum 
degree d, there are only finitely many isomorphism types for the balls of radius r 
centered at a vertex. It follows that any local formula £(x) with a single variable 
can be expressed as the conjunction of a finite number of (mutually exclusive) 
formulas £(f,o){ x ), which in turn correspond to subgraph testing. It follows that 
BS-convergence implies F0 1 1 ocal -convergence. 

Assume (G„)„ e N is F0 1 ocal -convergent and let <f>(xi, . . . , x p ) be an r-local 
formula. Let be the set of all p-tuplcs ((Fi, /i), . . . , (F p , f p )) of rooted con- 
nected graphs with maximum degree at most d and radius (from the root) at 
most r such that \J i F l |= (p(fi, ...,f p ). 

Then, for every graph G the sets 

{(ui,.. -,v p ) : G\= <j>(vu . . .,v p )} 

and 

|+J f[{v: GH^joW} 

((p , i,/i),...,(F I ,,/ p ))e^»=i 

differ by at most 0(|G| P_1 ) elements. Indeed, according to the definition of an 
r-local formula, the p-tuples {x\, . . . ,x p ) belonging to exactly one of these sets 
are such that there exists 1 < i < j < p such that dist(x i; Xj) < 2r. 
It follows that 

(<t>,G) = ( Yl 11(^,^0))+ 0(\G\-'). 

((f„/.))i<.< r e^ i=1 

It follows that F0 1 1 ocal -convergence (hence BS-convergence) implies full F0 loca 
convergence. □ □ 

According to this proposition, the BS-limit of a sequence of graphs with max- 
imum degree at most D corresponds to a probability measure on S'(F0 1 1 ocal (£)) 
(where L is the language of graphs) whose support is included in the clopen 
set K((d), where (d is the sentence expressing that the maximum degree is at 
most D. As above, the Boolean algebra F0 1 1 ocal (£) is isomorphic to the Boolean 
algebra defined by the fragment X C FOo(A) of sentences in the language of 
rooted graphs that are local with respect to the root. According to this lo- 
cality, any two countable rooted graphs (Gi,ri) and (G2,r2)> the trace of the 
complete theories of (G\,ri) and (G2,r 2 ) on X are the same if and only if the 
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(rooted) connected component (G[,ri) of (Gi,ri) containing the root r\ is el- 
ementary equivalent to the (rooted) connected component (G^,?^) of (G2,V2) 
containing the root r%. As isomorphism and elementary equivalence are equiv- 
alent for countable connected graphs with bounded degrees it is easily checked 
that Kx(Cd) is homeomorphic to Gd- Hence our setting leads essentially to the 
same limit object as [2j for BS-convergent sequences. 

We now consider how full FO-convergence differs to BS-convergence for se- 
quence of graphs with maximum degree at most D. This shows a remarkable 
stability of BS-convergence. 

Corollary 1. A sequence (G n ) of finite graphs with maximum degree at most 
d such that linin^oo \G n \ = oo is FO-convergent if and only if it is both BS- 
convergent and elementarily convergent. 

Proof. This is a direct consequence of Propositions [2] and |5j □ □ 

Explicit limit objects are known for sequence of bounded degree graphs, 
both for BS-convergence (graphing) and for elementary convergence (countable 
graphs). It is natural to ask whether a nice limit object could exist for full 
FO-convergence. We shall now answer this question by the positive. 

Let V be a standard Borel space with a measure \i. Suppose that Ti , T2, . . ■ , T). 
are measure preserving Borel involutions of X. Then the system 



is called a measurable graphing [T] . Here x is adjacent to y, if x 7^ y and Tj (x) = y 
for some 1 < j < k. Now if If V is a compact metric space with a Borel measure 
fj, and Ti,T2, . . . ,Tfc are continuous measure preserving involutions of V, then 
G = (V, Ti, T2, . . . , Tfc, /j,) is a topological graphing. It is a consequence of [3] and 
[5] that every local weak limit of finite connected graphs with maximum degree 
at most D can be represented as a measurable graphing. Elek [5] further proved 
the representation can be required to be a topological graphing. 

For an integer r, a graphing G = (V, Ti, . . . , T/., fi) and a finite rooted graph 
(F, o) we define the set 



We shall make use of the following lemma which reduces a graphing to its 
essential support. 

Lemma 4 (Cleaning Lemma). Let G = (V, Ti, . . . , T4, /a) be a graphing. 

Then there exists a subset X C V with measure such that X is globally 
invariant by each of the Ti and G' = (V — X, Ti, . . . , T^, /i) is a graphing such 
that for every finite rooted graph (F, o) and integer r it holds 



G = (V,Ti,T 2 ,...,T fe)M ) 



D r (G,(F,o)) = {xe G,B r (G,x) ~ (F,o)}. 



fi(D r (G',(F,o))) = fi(D r (G,(F,o))) 



(which means that G' is equivalent to G) and 
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Proof. For a fixed r, define J> has the set of all (isomorphism types of) finite 
rooted graphs (F, 6) with radius at most r such that fi(D r (G, (F, o))) = 0. 
Define 

*=U U D r (G,(F,o)). 

reN(F,o)GJ r r 

Then fJ,(X) = 0, as it is a countable union of 0-measure sets. 

We shall now prove that X is a union of connected components of G, that 
is that X is globally invariant by each of the T^. Namely, if x € X and y is 
adjacent to x, then i/el. Indeed: if x G X then there exists an integer r such 
that fj,(D(G,B r (G,x))) = 0. But it is easily checked that 

n{D(G, B r+1 (G, y))) < d ■ fi(D(G, B r (G, x)j). 

Hence y € X. It follows that for every 1 < i < d we have Ti(X) = X. So we 
can define the graphing G' = (V — X, Ti, . . . , Td, n). 

Let (F, o) be a rooted finite graph. Assume there exists x £ G' such that 
B r (G',r) ~ (F,o). As X is a union of connected components, we also have 
B r (G,r) ~ (F,o) and x $ X. 

It follows that fi(D(G, (F, o))) > hence fx(D r (G', (F, o))) > 0. □ □ 

The cleaning lemma allows us a clean description of FO-limits in the bounded 
degree case: 

Theorem 5. Let (G m ) n6 n be a FO-convergent sequence of finite graphs with 
maximum degree d, with linin^oo \G n \ — oo. Then there exists a graphing G 
and a countable graph G such that 

• G is a BS-limit of the sequence, 

• G is an elementary limit of the sequence, 

• G U G is an FO-limit of the sequence. 

Proof. Let G be a BS-limit, which has been "cleaned" using the previous lemma, 
and let G be an elementary limit of G. It is clear that G U G is also a BS-limit 
of the sequence, so the lemma amounts in proving that G U G is elementarily 
equivalent to G. 

According to Hanf's theorem [11] , it is sufficient to prove that for every 
integers r, t and for every rooted finite graph {F, o) (with maximum degree d) 
the following equality holds: 

min(t, \D r (G U G, (F, o))|) = min(t, \D r (G, (F, o))|). 

Assume for contradiction that this is not the case. Then \D r (G, (F, o))| < t and 
D r (G, (F, o)) is not empty. However, as G is clean, this implies fi(D r (G, (F, o))) = 
a > 0. It follows that for every sufficiently large n it holds \D r (G n , (F,o))\ > 
a/2 \G n \ > t. Hence \D r (G, (F,o))\ > t, contradicting our hypothesis. 

Note that the reduction of the satisfaction problem of a general first-order 
formula <f> with p free variables to a case analysis based on the isomorphism 
type of a bounded neighborhood of the free variables shows that every first- 
order definable subset of (G U G) p is indeed measurable (we extend /i to G U G 
in the obvious way, considering G as zero measure). □ □ 
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The cleaning lemma sometimes applies in a non-trivial way: 

Example 1. Consider the graph G n obtained from a Dc Bruijn sequence (see 
e.g. PI]) of length 2™ as shown Fig|] 





Figure 2: The graph G n is constructed from a De Bruijn sequence of length 2 n . 

It is easy to define a graphing G, which is the limit of the sequence (G n ) n£ iq: 
as vertex set, we consider the rectangle [0; 1) x [0;3). We define a measure 
preserving function / and two measure preserving involutions T\,T 2 as follows: 

((2x,y/2) if x < 1/2 and y < 1 

f{x, y) = I (2x — 1, (y + l)/2) if 1/2 < x and y < 1 
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otherwise 
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y - 
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if x < 1/2 and 2 < y 


(x 


y - 


2) 


if 1/2 < x and 2 < y 


(x 


y) 




otherwise 



Then the edges of G are the pairs {(x, y), (x', y')} such that (x, y) ^ (x' , y') 
and cither (x',y') = f(x,y), or (x,y) = f(x',y'), or {x',y') = T x {x,y), or 
(x',y') = T 2 (x,y). 

If one considers a random root (x, y) in G, then the connected component of 
(x, y) will almost surely be a rooted line with some decoration, as expected from 
what is seen from a random root in a sufficiently large G n . However, special 
behaviour may happen when x and y are rational. Namely, it is possible that the 
connected component of (x,y) becomes finite. For instance, if x = 1/(2™ — 1) 
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and y = 2 n ~ 1 x then the orbit of (x,y) under the action of / has length n 
thus the connected component of (x, y) in G has order 3n. Of course, such 
finite connected components do not appear in G n . Hence, in order to clean G, 
infinitely many components have to be removed. 

6 Conclusion and Further Works 

In a forthcoming paper [55], we apply the theory developed here to the con- 
text of classes of graphs with bounded diameter connected components, and in 
particular to classes with bounded tree-depth 19J. Specifically, we prove that 
if a uniform bound is fixed on the diameter of the connected components, FO- 
convergence may be considered component-wise (up to some residue for which 
FOi-convergence is sufficient). 

The prototype of convenient limit objects for sequences of finite graphs is 
a quadruple G = (V, E, E, p,), where (V,E) is a graph, (V, E,/x) is a standard 
probability space, and E is a measurable subset of V 2 . In such a context, modulo 
the axiom of projective determinacy (which would follow from the existence of 
infinitely many Woodin cardinals [IB]), every first-order definable subset of V' p 
is measurable in (V p ,Y, <g ' p ) [IS] . Then, for every first-order formula <f> with p 
free variables, it is natural to define 

(1>,G) = [ U dfi®P. 

In this setting, G = (V, E, E, p) is a limit — we don't pretend to have uniqueness 
— of an FO-convergent sequence (G n )neN of finite graphs if for every first-order 
formula ip it holds 

(iP,G) = lim (il>,G n ). 

n— > oo 

We obtain in [55] an explicit construction of such limits for FO-convergent se- 
quences of finite graphs bound to a class of graphs with bounded tree-depth. It 
is also there where we develop in a greater detail the general theory explained 
in the Sections [2j and [3] Notice that in some special cases, one does not need 
a standard probability space and a Borel measurable space is sufficient. This 
is for instance the case when wc consider limits of finite connected graphs with 
bounded degrees (as we can use a quantifier elimination scheme to prove that 
definable sets are measurable) or quantifier-free convergence of graphs (definable 
sets form indeed a sub-algebra of the cr-algebra). 
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